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ABSTRACT 



This report addresses the Florida Community College System’s 
( FCCS ) performance based on measures established by the General 
Appropriations Act. Discussed are: (1) FCCS’ performance on the measures used 

in the performance-based budgeting (PBB) incentive fund; (2) improvements 
that can be made to the PBB incentive fund; and (3) changes to community 
college PBB that would provide better information on systemwide performance . 
FCCS’ performance-based budgeting approach differs from other approaches used 
in Florida by directly linking community college performance to a portion of 
state funding. Specifically, this approach awards points to the community 
colleges based on a number of output and outcome indicators. Community 
colleges then receive a portion of the incentive funds based on the number of 
points they accrue. Results for the 1996-97 performance-based budgeting 
incentive fund measures suggest that FCCS gained efficiency in its degree and 
certificate programs. Appended are: data tables that illustrate how the 
current effectiveness and improvement awards could be calculated; and a 
response to the report from the Florida State Board of Community Colleges. 
(EMH) 
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Executive Summary 
Report No. 97-49 

Review of the Community College System's 
Performance-Based Program Budgeting 
Measures and Incentive Fund 



Scope 



Background 



Conclusions 



This report addresses the Community College System's performance based on measures 
established by the General Appropriations Act. In this review, we examined: (1) the 

Community College System's performance on the measures used in the performance-based 
budgeting (PB 2 ) incentive fund; (2) improvements that can be made to the PB 2 incentive 
fund; and (3) changes to community college PB 2 that would provide better information on 
system-wide performance. Our second report, which will be issued by July 1, 1998, will 
provide an assessment of System performance and will address alternatives for reducing 
costs and improving service delivery. 

The Community College System provides a variety of educational and job training programs 
to Florida citizens. Its primary mission is to respond to community needs for postsecondary 
academic and vocational education. The Legislature began funding the Community College 
System under a performance-based program budget in Fiscal Year 1996-97. The Legislature 
appropriated $12 million to provide performance- based incentives to the community 
colleges in Fiscal Years 1996-97 and 1997-98, which represented approximately 2% of the 
total state appropriations for community colleges in these years. 



The Community College System’s performance-based budgeting approach differs from 
other approaches used in Florida by directly linking community college performance to a 
portion of state funding. Specifically, this approach awards points to the community 
colleges based on a number of output and outcome indicators. Community colleges then 
receive a portion of the incentive funds based on the number of points they accrue. 
Community colleges can also earn incentive funds from another source. 



Instead of specifying a broad set of output and outcome measures upon which to judge the 
performance of the Community College System, the Legislature took a more limited PB 2 
approach for community colleges by creating an incentive fund that focuses on selected 
performance indicators. In doing so, the Legislature directly linked a portion of community 
college funding to actual performance in some key areas. However, using these measures 
alone limits the conclusions that can be made about overall System performance. Despite 
this limitation, the 1996-97 performance-based budgeting incentive fund measures indicate 
the Community College System gained some efficiency in its degree and certificate 
programs. 
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The current PB 2 incentive fund includes some characteristics of an ideal performance-based 
funding system. For instance, the PB 2 incentive fund provides a simple, straightforward 
way of distributing incentive money to community colleges. However, the PB 2 incentive 
fund could be improved to strengthen the incentives provided to community colleges to 
improve their current performance. For example, community colleges earn incentive dollars 
without having to demonstrate performance improvement. Also, in competing for incentive 
funds, some colleges may be at a disadvantage due to the types of programs they are 
providing. 

Finally, while the incentive fund measures may help to improve System efficiency in some 
important areas, they are of limited usefulness for judging system-wide performance and 
effectiveness. A broader set of measures and standards is needed to fully assess the quality 
and effectiveness of the Community College System. 



Recommendations better ensure accountability to stakeholders, the performance-based budgeting approach 
„ for community colleges should be expanded to include a more comprehensive set of 

measures that focuses on System-wide goals. These measures should cover the major 
responsibilities of the System and set expectations for success. Thus, we recommend that 
the Legislature retain the incentive fund as part of the Community College System's 
Performance-based Budget but supplement it by including a broader set of measures with 
associated (system-wide) standards in the General Appropriations Act. This 
recommendation can be implemented without having to develop many new measures. 
Community colleges already report many of these indicators through their annual 
Accountability Plan report and legislative budget request. 

We also recommend that the Legislature change how it distributes performance-based 
budgeting incentive funds to the community colleges. At a minimum, we recommend the 
following three changes: (1) distribute incentive funds based on meeting established success 
criteria; (2) incorporate program length into the distribution of incentive funds for vocational 
certificate programs once program lengths are standardized; and (3) add a measure for the 
percentage of AA degree transfer students who achieve a GPA of 2.5 or higher in the State 
University System. To implement, these changes, we recommend that the PB 2 incentive 
fund be restructured around four primary measures: (1) Current Effectiveness, 

(2) Improvement (3) Special Population Completion, and (4) Excess Hours/Efficiency. 



Agency Response 



The Acting Executive Director of the Community College System, in his written response to 
our preliminary and tentative findings, generally agreed with our observations and finding 
regarding the System's performance-based budgeting measures and incentive fund. He 
agreed that the PB 2 incentive fund could be improved and that a broader set of measures and 
standards would be needed to "fully assess the quality and effectiveness of the Community 
College System." However, he does not believe that it is necessary or even desirable to have 
a funding system that attempts to fully assess the quality and effectiveness of the System. 
He also agreed with our position that measures expressed as rates would provide more 
meaningful information about their institutions, but he does not necessarily agree that such 
measures should be incorporated into performance-based budgeting. 



OPPAGA provides objective, independent, professional analyses of state policies and services to assist the Florida Legislature 
in decision-making, to ensure government accountability, and to recommend the best use of public resources. Copies of this 
report in print or alternate accessible format may be obtained by telephone (850/488-0021 or 800/531-2477), by FAX 
(850/487-3804), in person (Claude Pepper Building, Room 312, 111 W. Madison St.), or by mail (OPPAGA Report 
Production, P.O. Box 1735, Tallahassee, FL 32302). 
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The Florida Legislature 




John W. Turcotte, Director 



February 1998 



The President of the Senate, 
the Speaker of the House of Representatives, 
and the Legislative Auditing Committee 

As requested by the Legislative Auditing Committee, I have directed that a review be 
made of the use of performance-based program budgeting for the Community College 
System. The results of this review are presented to you in this report. This review was 
conducted by Tim Elwell, Yvonne Bigos, Glenn Chavis, Dorothy Gray, Steve Smith, and 
Linda Ward, under the supervision of Jane Fletcher. 

We wish to express our appreciation to the staff of the Department of Education for their 
assistance. 




Director 
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Executive Summary 



Report No. 97-49 



Review of the Community College System’s 
Performance-Based Program Budgeting 
Measures and Incentive Fund 



Scope 



Background 



This report addresses the Community College System's 
performance based on measures established by the General 
Appropriations Act. In this review, we examined: (1) the 

Community College System's performance on the measures 
used in the performance-based budgeting (PB 2 ) incentive fund; 
(2) improvements that can be made to the PB 2 incentive fund; 
and (3) changes to community college PB 2 that would provide 
better information on system-wide performance. Our second 
report, which will be issued by July 1, 1998, will provide an 
assessment of System performance and will address 
alternatives for reducing costs and improving service delivery. 

The Community College System provides a variety of 
educational and job training programs to Florida citizens. Its 
primary mission is to respond to community needs for 
postsecondary academic and vocational education. The 
Legislature began funding the Community College System 
under a performance-based program budget in Fiscal Year 
1996-97. The Legislature appropriated $12 million to provide 
performance-based incentives to the community colleges in 
Fiscal Years 1996-97 and 1997-98, which represented 
approximately 2% of the total state appropriations for 
community colleges in these years. 

The Community College System’s performance-based budgeting 
approach differs from other approaches used in Florida by 
directly linking community college performance to a portion of 
state funding. Specifically, this approach awards points to the 
community colleges based on a number of output and outcome 
indicators. Community colleges then receive a portion of the 
incentive funds based on the number of points they accrue. 
Community colleges can also earn incentive funds from another 
source. 
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Conclusions 



Recommendations 
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Instead of specifying a broad set of output and outcome 
measures upon which to judge the performance of the 
Community College System, the Legislature took a more 
limited PB 2 approach for community colleges by creating an 
incentive fund that focuses on selected performance indicators. 
In doing so, the Legislature directly linked a portion of 
community college funding to actual performance in some key 
areas. However, using these measures alone limits the 
conclusions that can be made about overall System 
performance. Despite this limitation, the 1996-97 
performance-based budgeting incentive fund measures indicate 
the Community College System gained some efficiency in its 
degree and certificate programs. 

The current PB 2 incentive fund includes some characteristics of 
an ideal performance-based funding system. For instance, the 
PB 2 incentive fund provides a simple, straightforward way of 
distributing incentive money to community colleges. However, 
the PB 2 incentive fund could be improved to strengthen the 
incentives provided to community colleges to improve their 
current performance. For example, community colleges earn 
incentive dollars without having to demonstrate performance 
improvement. Also, in competing for incentive funds, some 
colleges may be at a disadvantage due to the types of programs 
they are providing. 

Finally, while the incentive fund measures may help to 
improve System efficiency in some important areas, they are of 
limited usefulness for judging system-wide performance and 
effectiveness. A broader set of measures and standards is 
needed to fully assess the quality and effectiveness of the 
Community College System. 



To better ensure accountability to stakeholders, the 
performance-based budgeting approach for community 
colleges should be expanded to include a more comprehensive 
set of measures that focuses on System-wide goals. These 
measures should cover the major responsibilities of the System 
and set expectations for success. Thus, we recommend that the 
Legislature retain the incentive fund as part of the Community 
College System's Performance-based Budget but supplement it 
by including a broader set of measures with associated 
(system-wide) standards in the General Appropriations Act. 
This recommendation can be implemented without having to 
develop many new measures. Community colleges already 
report many of these indicators through their annual 
Accountability Plan report and legislative budget request. 
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We also recommend that the Legislature change how it 
distributes performance-based budgeting incentive funds to the 
community colleges. At a minimum, we recommend the 
following three changes: (1) distribute incentive funds based 
on meeting established success criteria; (2) incorporate 
program length into the distribution of incentive funds for 
vocational certificate programs once program lengths are 
standardized; and (3) add a measure for the percentage of A A 
degree transfer students who achieve a GPA of 2.5 or higher in 
the State University System. To implement, these changes, we 
recommend that the PB 2 incentive fund be restructured around 
four primary measures: (1) Current Effectiveness, 

(2) Improvement (3) Special Population Completion, and 
(4) Excess Hours/Efficiency. 

The Acting Executive Director of the Community College 
System, in his written response to our preliminary and tentative 
findings, generally agreed with our observations and finding 
regarding the System’s performance-based budgeting measures 
and incentive fund. He agreed that the PB 2 incentive fund 
could be improved and that a broader set of measures and 
standards would be needed to "fully assess the quality and 
effectiveness of the Community College System." However, 
he does not believe that it is necessary or even desirable to 
have a funding system that attempts to fully assess the quality 
and effectiveness of the System. He also agreed with our 
position that measures expressed as rates would provide more 
meaningful information about their institutions, but he does not 
necessarily agree that such measures should be incorporated 
into performance-based budgeting. 
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Purpose 



Background 
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Introduction 



This is the first of two reports presenting the results of 
our program evaluation and justification review of the 
Community College System. State law directs the 
Office of Program Policy Analysis and Government 
Accountability to complete a program evaluation and 
justification review of each state agency program that is 
operating under a performance-based budget. Our 
Office is to review each program’s performance-based 
program budgeting measures and standards and identify 
alternative means of providing program services. 

This report addresses the Community College System's 
performance based on measures established by the 
General Appropriations Act. In this review, we 
examined: (1) the Community College System's 

performance on the measures used in the 
performance-based budgeting (PB 2 ) incentive fund; 
(2) improvements that can be made to the PB 2 incentive 
fund; and (3) changes to community college PB 2 that 
would provide better information on system-wide 
performance. Our second report, which will be issued 
by July 1, 1998, will provide an assessment of System 
performance and will address alternatives for reducing 
costs and improving service delivery. 



The Community College System provides a variety of 
educational and job training programs to Florida 
citizens. Its primary mission is to respond to 
community needs for postsecondary academic and 
vocational education. This includes: 

• providing lower level undergraduate instruction 
designed to award associate degrees and prepare 
students to transfer to four-year colleges and 
universities; 

• preparing students for vocations requiring less than 
a baccalaureate degree; 
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• providing a range of student development services 
such as assessment, counseling, and remediation; 
and 

• promoting economic development within each 
community college district by providing special job 
training programs. 



A secondary role for the System is to provide 
community services not directly related to academic or 
occupational advancement, adult general education, and 
recreational and leisure services. 

The 1 994 Government Performance and Accountability 
Act directs state agencies to submit performance-based 
program budget requests, which include proposed 
performance measures and standards, to the Legislature 
for approval. 1 The Legislature approves performance 
measures and standards and includes these in the 
General Appropriations Act. State agencies must 
annually report on performance against these standards 
to the Governor and the Legislature in their legislative 
budget requests. The Legislature considers this 
information when making funding decisions. The 
Legislature can also award incentives and disincentives 
for program performance that exceeds or fails to meet 
the established standards. 

The Legislature began funding the Community College 
System under a performance-based program budget in 
Fiscal Year 1996-97. The Legislature appropriated $12 
million to provide performance-based incentives to the 
community colleges in Fiscal Years 1996-97 and 
1997-98, which represented approximately 2 % of the 
total state appropriations for community colleges in 
these years. 2 The Legislature added the Fiscal Year 
1996-97 incentive amount ($12 million) into the 
System's base funding for 1997-98. These funds are 
awarded for performance in three program areas: 
Associate in Arts, Associate in Science, and Vocational 
Certificates. 




1 Standards are expected levels of performance against which actual performance is to be compared. 

2 Total state appropriations for Fiscal Year 1996-97 and 1997-98 for the Community Colleges System were $713,170,548 



and $761,916,764, respectively. 
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